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ABSTRACT 



A method for taking advantage of external recongnition to 
thereby render only those computer generated objects that 
are from any orientation and viewing angle. Intemal com- 
ponents and hidden components are omitted from the ren- 
dered image. This method applies only to assembly and 
sub-assembly models and not to individual components 
models. 

11 Claims, 3 Drawing Sheets 
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EXTERNAL RECOGNITION AND 
RENDERING METHOD 

BACKGROUND OF THE INVENTION 

a) Field of the Invention 

The present invention relates to a method and associated 
computer software for improved visualization and interac- 
tion with three dimensional graphics, whereby the system 
renders only what the user sees and does not waste time 
rendering hidden components. 

b) Description of Related Art 

Recent modeling simplification efforts, using Computer 
Aided Design (CAD) systems, focus on reducing the num- 
ber of polygons in a visual model. Surfaces in CAD model 
are tessellated to generate polygons, llie collection of poly- 
gons is then used as a visual model, llie current method 
relying on the polygon based "Level of Details" (LOD) 
approach is unwieldy. It requires loading all the information 
about the entire mechanical model. Such a data set far 
exceeds the capability of present-day graphics hardware to 
interactively render the model, no matter the polygon count. 
Today, modeling applications demand an instantaneous, 
interactive display of models. 

Heckbert in "Ten Unsolved Problems in Rendering, 
Workshop on Rendering Algorithms and Systems" provided 
a list of ten unsolved problems in simplifying models for 
rendering. Among them is the problem of how to more fully 
automate the levels of details and hierarchical bounding 
boxes. Heckbert noted that setting up a level of details 
database is burdensome and causes uneven transitions when 
switching levels. For simulation work, this is quite unac- 
ceptable. 

Researchers have investigated and pursued numerous 
simplification approaches. Among them are the octree, 
wavelet and the favored multi-resolution technique. Srihari 
in "Multi-resolution 3-d Image Processing and Graphics" 
showed how octree models can be used for displaying 
voxel-based images at different levels of detail. In an octree, 
each level of the tree increases the resolution by a factor of 
eight. This allows one to view an object as a gradual process 
proceeding from a father node to its sons. Gortler, et al in 
"Hierarchial and Variational Geometric Modeling with 
Wavelengths" used the hierarchical nature of wavelet basis 
functions to obtain multi-resolution control point and ]east 
squares control. A wavelet basis represents a solution hier- 
archically. In wavelet based schemes, the user chooses the 
resolution level 1, and then only the quantities of basis 
function on level 1 are altered. However, multi-resolution 
models are the models of choice for simplifying renderings 
and simulations. A few researchers such as Harten 
("Multiresolution Representation and Numerical 
Algorithms") and Gauch ("Multiresolution Image Shape 
Description") have developed multiresolution techniques. 

In 1994, Heckert et al. presented "Multiresolution Mod- 
eling For Fast Rendering" which surveyed multi-resolution 
techniques for accelerated rendering and found that a poly- 
hedral simplification method was the most appropriate for 
accelerated rendering and simulalioo. Subsequently, com- 
mercial packages that used the multi-resolution technique 
became available. Among them are: the 3D Accelerator (see 
Rossignac et al., "Muhi-resolution 3D approximations for 
rendering complex scenes"), a polyhedral simplification 
method, and Dcncb Robotics optional package called HIFI, 
which is a polygonal simplification method. 

However, the muUi-resolulion modeling technique has 
limitations. Multi-resolution models are scene dependent. 
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2 

They require the preparation of a level of details database for 
each scene. This is a lengthy process that requires input from 
the user for each scene and each model. All objects (external 
and internal) must be prepared, stored in the database, and 
5 rendered whether or not the objects are visible during the 
simulation. 

Decomposing a CAD model into polygons before render- 
ing it for visualization typically produces thousands of 
polygons. The software algorithms that underlie the mod- 

10 eled object, generate an eveN smaller set of polygons that 
are visually similar to the original object. By creating 
multiple levels of detail (fore, mid and background) at 
varying resolutions, the work of a graphics engine is 
reduced. However, important visible features are lost in such 

^5 simphfication processes. Moreover, the polygonal simphfi- 
cation methods still cannot deliver the requisite display 
speed for large mechanical models. 

A mechanical environment consists of whole mechanical 
parts and assembhes. A person recognizes a piece of equip- 
menl not by taking it apart and investigating its internals, but 
by simply looking at its external surfaces, its "container." No 
one needs to take apart an automobile to recognize what it 
is, even though the interior parts are hidden from the viewer. 
The polygon based LOD technique loads all the information, 
both interior and external, and does not take advantage of the 
physical reality of a mechanical environment. 

SUMMARY OF THE PRESENT INVENTION 

The present invention seeks to overcome the drawbacks 
inherent in the prior art by providing a method for taking 
advantage of external recognition to thereby render only 
what is visibly displayed to the user. Internal components 
and hidden components are omitted from the rendered 
image. 

The invention set forth herein is considerably more effi- 
cient because it is scene independent. It processes the CAD 
models, and prepares a simplified visual container database 
off-line. It guarantees that only visual objects of an assembly 

^ are loaded and rendered for simulation. Internal objects are 
loaded and rendered as needed. All the processing is done 
off-line. Simulation time decreases because there are few 
surfaces to display. This method makes it a powerful tool for 
faster rendering and simulation. 

45 Taking advantage of this external recognition makes it 
possible to display CAD models much faster than is cur- 
rently possible. Significant computational efiBciencies are 
produced by decoupling the internal and external compo- 
nents of a visual assembly. The external container is dis- 

50 played and manipulated without loading all the visual geom- 
etry information. Internal component information is loaded 
into the display engine only as it is needed. 

A key concept underlying the container approach of this 
invention is the use of a mechanical component (MQ object. 

55 This object is a CAD model (solid or 3D surface) of a 
mechanical component. An MC object is comprised of either 
the 3D surfaces or the primitive solids and not the tesselated 
polygons. In a given assembly an MC object may contain, be 
contained within, penetrated in, abut, or be similar to another 

60 MC object. 

A generational paradigm helps define the relationship 
between the MC objects of an assembly. Object positions 
can be identified through a "relationship tree." An MC object 
that contains one or more objects is a 'parent' object. The 

65 objects within the parent object are its 'children.' Two 
penetrating objects are 'spouses', whereas objects sharing a 
common boundary are 'siblings.' 1\vo identical objects are 
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'twins.'Aclusterof related objects comprise the 'assembly.' external visibility of MC objects. Objects are sorted 

Using the concept of containers and the concept of MC into externally visual objects, or interior non-visible 

objects, the present invention proposes software to signifi- objects; 

cantly reduce the level of detail required for visualization. fourth, at step 8 the algorithm that calculates the container 

To create improved visualization speed, the proposed 5 by determining the visual objects in each assembly and 

invention: 1) extracts from existing CAD models an assem- objects attached to each assembly; and 

bly's combinatorial (topological) structure and metric step 10 the algorithm that maintains a link 

(geometric) information; 2) separately identifies the between the assembly's visual container and the origi- 

external, visible features from the interior ones; 3) display CAD model. The hierarchical relationship between 

only the assembly's visual geometry; and 4) link the original ^0 l^i© assembly and its MC objects is retrieved from the 

CAD model components within an assembly to its visually object's relationship tree, 

displayed "container" geometry. Using a file transfer and translator program to import and 

ITie present invention sets forth an Automatic Container ^'^P"^ information, the ACS system shall interface with 

Simplification (ACS) system which can meet the aforemen- popular CAD and visualization systems. Usually a CAD 

tioned requirements and include the following features: ^y^^^^ proprietary database to store CAD 

(1) a visual container database that is based on the ^vlte^lrS n^npf ^^^^^ ^ "'"'"'^"''^ ^T''* ^""l 

surfaces that are visible to the viewer; Trtn f^ a^c' f ^T' V 

. the CAD models mto the ACS system and another program 

(2) a contamer database that is compatible with multi- will export the visual containers to a visualization program, 
resolution modeling schemes as well as display sys- 20 Additionally, the ACS system will prepare a visual container 
*^™^» database that is suitable for preparing LOD multiresolution 

(3) a database that is comprised of surfaces and, therefore, models. 

can be directly rendered; The software modules of the ACS system will now be 

(4) simplified models that retain all important visible described along with the details of the tasks of each module 
feature^ 25 and, lastly, the mathematical underpinnings of the ACS 

(5) viewing angle and orientation independent visibility system algorithms. 

for users- ^ shown in FIG. 1 and described above, the ACS system 

(6) visual contamer database preparation oif-line to speed ^ "^TJ^^ ""f "Pf"""" 

up the on-line interactive visialization with users; and ,„ P^^l'l^ff-Sff^^i^ Tl ^ '""f 

'30 assemblies. The specific tasks involved are reading visual 

(7) an interactive on-lme link to all container objects, as data for two test assemblies and generating in the ACS 
well as MC objects (CAD models) during display. system the corresponding visual container database, imple- 

These and other benefits of the present invention will menting the algorithms that sort the objects of an assembly 

become apparent to those of skill in the art with reference to external and internal (visible and invisible) objects and 

the followmg drawings and description. 35 determining the visual container for the assembly and its 

BRIEF DESCRIPTION OF THE DRAWINGS objects, displaying the test assembly visual container 

models, and reading visual container data for two assemblies 

no. 1 is a flow diagram showing algorithms of the and transporting it to the display program, 

automatic container simplification system of this invention; First, the basic software modules of this invention process 

FIG. 2 illustrates an exploded view of a pump showing its 40 the CAD models of components of two test assemblies and 

components: a volute casing, casing cover, suction pipe, extract the visual information from the CAD models. The 

pump shaft, impeller, and hub. invention then sorts the objects in a given assembly for 

FIG. 3 shows the containment boxes such that each box interior and visible objects. Next, the system determines the 

encloses a component. visual containers for a set of visible objects and their 

FIGS. 4, 5 and 6 show the larger containment boxes of assembly and transfers the visual container data of two test 

pjQ 3 assemblies to the visualization program whereby the assem- 
blies are displayed. 

DETAILED DESCRIPTION OF PREFERRED The next sections describe the definitions, procedures, and 

EMBODIMENT major algorithms used to implement the ACS system, 

-nie automatic container simplification or ACS system of '° ^.^f "^Sorithm of the AO system classifies the 

this invention is comprised of innovative algorithms. These an assembly, defining those tha are penetrated. 

, f, u • 1 u 1 . • 1 . adjacent, containing another object, or contained within an 

algonthms generate the mechanical assembly s equivalen . 'ri, 1 iu u . u ^ j u . 1 - I 

r>r.r.tTi»^. cT/- 1 V « fl^ u ' object. The algorithm can best be described by taking two 

visual container. FIG. 1 is a flow diagram showing five # ««i * «• r . • . • . 

oi„^„tv,«,o Anc ^,..t Tu ft 1 -^u objects and testing for containment or mtersection. 

algonthms of the ACS system. The five algorithms are u- J^- * « • j -.u- .t. i_- * 

described as foUows' . . ^ contained withm another object, it 
- L is either adjacent to or penetrates the other object. For object 
first at step 2 the algonthm that extracts the visual classification, it is first determined whether or not one is 
information such as shape color material type, and contained within the other. Hoffman, "Geometric and Solid 
surface texture, from the CAD model and mamtams the Modeling: An Introduction" provides an algorithm, cafled 
pointers to the original CAD models; ,o ^he "line/solid classification algorithm", to determine 
second, at step 4 the algorithm that classifies the relation- whether or not an object is within another given object. The 
ship of MC objects to each other and creates a rela- line/solid classification algorithm may be described as fol- 
tionship tree. The relationship tree pointers identify the lows: Take two points p and q on two non-intersecting 
links among objects; that is, whether they are children, bounding objects A and B. The two points are connected by 
siblings, spouses, or twins; 65 an imaginary Une segment. ITiis line segment is then ana- 
third, at step 6 the algorithm to sort objects into exterior lyzed for how it (p,q) intersects with the boundaries of A and 
and interior objects. This algorithm determines the B. The segment intersects the boundaries of A and B in a 
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number of points that are ordered linearly and then the line 
segment is partitioned into many intervals. Each interval is 
classified as being either outside or inside A, and, either 
being inside or outside B. Both end points of each interval 
may lie on the boundaries of only A or only B. However, 5 
there are intervals with one end point on the boundary of A 
and the other end point on the boundary of B. The algorithm 
chooses the first such interval, scanning the intervals in order 
beginning at p. A test is then performed to determine 
whether this interval is inside or outside A and B. If the lO 
interval is outside A but inside B, then A is contained with 
B. However, if the interval is inside A and outside B, then B 
is contained in A. 

The second algorithm in ACS system sorts the objects in 
an assembly for external (visual) or interior. However, 15 
before detailing the algorithm the notations are described. 
They are as follows: Given two objects A and B, we can say 
that cither B is within A, B penetrates A, B is adjacent to A, 
A and B are identical, or A and B are isolated from each 
other. If B is completely enclosed by A then B is a child of 20 
A denoted Be A. If B penetrates A, then B is a spouse of A 
and is denoted APlB. If B is adjacent to A then B is a sibling 
of A and is denoted A U B. 

Consider N objects Yj, Y^, . . . , Y^, forming a set Y Let 
there be a set Z of M<N objects such that Z is a subset of Y. 25 
An object Y^^Yj-1, . . . , N is also a member of the set Z, 
if 



TABLE 1 -continued 



Yj<^Yi, and 

j=l, . . . ,N, i=l, . . . ,M. M<N. 



(1) 
(2) 
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An object Y^ is a child of another object Y,- if Y^DY^-^Yy and 
the two objects Yj and Y- are disjointed if YynY,.«0. 

The two conditions given above can be used to develop an 
eflScient code that determines the set of visual objects Z of 
an assembly Y of N objects. The algorithm starts by select- 
ing an object Y^ that is a visual objecl, that is, Y^eZ. This 
choice is made by the user. The algorithm then picks an 
object Y2 from the set of N-1 remaining objects and 
determines whether or not Yj is a child of Y^- If Y^ is not 
a child of Yj, that is, Y^ c Yj, then the algorithm determines 
whether or not Y^ is disjointed from Yj. If Y^ is not 
disjointed from Yj, that is, Y^DYz, then the algorithm 
selects the next object Y3 from the remaining N-2 objects 
and determines whether or not Y^ is a child of the next object 
Y3 or disjointed from it. This process is repeated until all 
N-1 objects are considered. If object Yj is not any object's 
child and is not separated from any N-1 object, then it is 
considered a visual object. Otherwise it is not. In this manner 
all N objects are evaluated, llie pseudo code of this algo- 
rithm is given in Table 1. 



TABLE 1 



The pseudo code for object sorting is listed below: 

start with a visual object 
for j-l,N 

Y^ez 

for i-j+l,N 

determine if Yj n Yj 
if (Yj n Y, p Y,) then 
if (Yj n Y, - 0) then 
Y, < Z 

else 

YjGZ 



55 



60 



65 



The pseudo code for object sorting is listed below: 
endif 

else 

Yj * Z 
endif 
increment j 



Important components of the above algorithm are to: (1) 
determine whether or not a given object Y. penetrates 
another object Y,-; and (2) if two given objects Yy and Y,. do 
not penetrate, then to determine whether or not the object Yy 
is a child of the object Y,-. 

Determining whether or not two objects penetrate and 
then determining whether or not one is a child of the other 
is relatively complex. However, it can be greatly simplified 
by using object containment boxes. The object containment 
box (OCB) is a minimum rectangular prismatic volume that 
encloses an object. There are many algorithms available that 
describe the methods to determine the containment box of a 
given object. Martin et al. in "Containment Algorithms for 
Objects in Rectangular Boxes" provided one of these algo- 
rithms for 3D objects. Determination of the containment box 
for a 3D object is a solved problem and one of the available 
solutions which will be utilized by this invention. This 
invention however sets forth a procedure using the contain- 
ment boxes for sorting the interior and visual objects. 

In an assembly two object containment boxes can be 
related to each other in one of five ways: (1) one is contained 
within the other; (2) they penetrate (protrude from) each 
other; (3) intersect each other; (4) they are adjacent to (a 
vertex, edge, or portion of face of one box touches the other 
box) each other; and (5) they arc isolated from each other. 

If two containment boxes are adjacent to or intersect each 
other, they are enclosed by a larger containment box. The 
larger containment box is then used for further evaluation. 
This is continued until a containment box contains a cluster 
of adjacent or intersected boxes. The large containment 
boxes containing the cluster of objected are then evaluated 
to determine whether or not one contains the other. If two 
large boxes are not within each other, the objects enclosed 
by the two boxes are visual objects. If one large box contains 
the other, the objects enclosed by the inner box are the 
interior objects. The objects enclosed by the boxes that 
penetrate the visual boxes are also visual objects. 

The above procedure is illustrated by an example of a 
centrifugal pump. Of course, the pump of FIG. 2 is to be 
rendered in its assembled state, but each component is 
individually stored on a computer and the following analysis 
is basedon the category of elements shown individually and 
assembled. FIG. 2 illustrates an exploded view of a pump 
showing its individual components: a volute casing 20, 
casing cover 22, suction pipe 24, pump shaft 26, impeller 28, 
and hub 30. FIG. 3 shows the containment boxes such that 
each box encloses a component, i.e., the box 20a encloses 
the volute casing 20, the box 24a encloses the suction pipe 
24, and the box 22fl encloses the casing cover 22. Boxes 20a, 
24a and 22a are adjacent, therefore a larger box 40 encloses 
the boxes 20fl, 24a, and 22^ (see FIG. 4). The boxes 
enclosing the impellar, impellar vane and hub intersect and 
are thus enclosed in a larger box 50, Box 50 is adjacent to 
but does not intersect box 60, therefore, the two boxes 50, 
60 are surrounded by a larger box 70. FIGS. 4, 5 and 6 show 
the larger boxes 40, 50, and 70. The two large boxes, box 40 
and 70, are then evaluated to determine whether or not one 
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of the two boxes is contained within the other. Box 70 is 
contained within box 40, therefore the objects within box 70 
are declared interior objects. The objects within box 40 are 
the visual objects. The box containing the shaft 26 protrudes 
box 40, therefore it contains a visual object. 5 

This method detennines that the visual objects are the 
volute casing 20, its cover 22, suction pipe with the flange 
24, and the pump shaft 26. 

The final algorithm of the ACS system determines the 
visual container for a cluster of visual objects. The visual 10 
container is determined by performing the union of the set 
of visual objects. The union of the visual objects is deter- 
mined by calculating the intersection of the object surfaces. 
The intersection of surfaces can be calculated and deter- 
mined by known methods. is 

While the foregoing invention has been described in 
relation to certain algorithms and an example using a pump, 
it will be understood that this description provides the basic 
disclosure of the present method whereby a computer graph- 
ics system renders only what the user sees and does not 20 
waste time rendering hidden components. Of course, 
changes in form and detail may be made to the foregoing 
description without departing from the basic inventive 
method for graphics rendering. 
What is claimed is: 25 
1. A method for rendering graphic images, said method 
coron risipg tjy stfip of: 



^{^cting^ topological stnictur^ and geometric informa- 
tion trom a computer generated model; 

identifying &om said model internal non-visible features 
that are internal to the model and external visible 
features that are external to the model; 

generating a rendered image comprising only those exter- 
nal visible features of a computer generated model that 
are visible independent of a user's viewing orientation; 



30 



visually displaying only said external inviable features as 
said rendered image. 

2. The method of claim 1, further comprising the step of 
linking the internal non-visible features to the external 
features. 

3. The method of claim 1, wherein hidden components not 
visible from a user's viewing orientation are omitted from 
said rendered image. 

4. The method of claim 1, wherein components of said 
model are compared to ascertain intersection of said com- 
ponents. 

5. The method of claim 1, wherein first and second 
components of said model are compared to ascertain if said 
first component contains said second component. 

6. The method of claim 1, further comprising the step of 
determining a set of external visible features. 

7. The method of claim 6, wherein the step of determining 
said set of external visible features comprises identifying a 
user-defined visual object. 

8. The method of claim 7, wherein at least one additional 
object is automatically selected and compared with said 
user-defined visual object to ascertain if said at least one 
additional object intersects said user-defined visual object. 

9. The method of claim 8, further comprising the step of 
calculating an intersection of said external visible features. 

10. llie method of claim 8, wherein a second object is 
compared with said user defined visual object to ascertain if 
said at least one additional object contains said user-defined 
visual object. 

11. The method of claim 10, wherein a second object is 
compared with said user defined visual object to ascertain if 
said at least one additional object is disjointed from said 
user-defined visual object. 
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